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Background Of The Invention 

In a computer network environment, hundreds or even thousands of 
computer systems may be connected by a communication channel. They can all 
5 communicate with each other through many different communication protocols. 
Each protocol has a particular way to link the systems together to transmit data 
from one to another. To help the systems cooperate more closely, resource 
sharing mechanisms have been developed to allow computer systems to share files 
across the computer network. One example of such a mechanism is the client- 

10 server Network File System (NFS) developed by Sun Microsystems. By sharing 
the files across the network, every client system on the network can access the 
shared files as if the files were local files on the client system, although the files 
may be physically located on and managed by a network server system at a remote 
location on the network. The file sharing provided by the NFS enhances the 

15 network operation with the following features: 

a. Each client system no longer needs to physically keep a local copy 
of the files. 

b. Every client system can access the shared files in the same manner 
as it accesses its own local files. 

20 c. There is only one copy of files located on and managed by a 

network server, so it is always the only version and always up-to- 
date. 

This file sharing provided by the NFS works well in a small or middle size 
network environment. As more client systems are added to the network, and more 
25 subnets are connected to the network, more routers and switches are needed to 
interconnect many different small networks or sub-networks to form a large 
network. A network server that shares its files across such a network to the client 
systems faces the following problems: 



1 . The network server is loaded heavily by increasing requests from 
many client systems on the network. To alleviate the load problem, 
the network server can be upgraded to add more CPUs on the 
system, and the storage devices which store the shared information 

5 can also be upgraded to provide more bandwidth on their data 

channels, so that requests for the information from client systems on 
the network can be serviced without delays. 

2. The network is congested with the traffic generated by the client 
systems' requests from all different directions and the server's 

10 return. To alleviate the congestion problem, the bandwidth of 

network communications media can be increased to accommodate 
more traffic and faster routers and/or switches can be added to 
transfer data packets faster on the network. 
By using more CPUs on the system, faster data channels on the storage 
15 media, increased network bandwidth, and adding faster routers and/or switches, 
the overloading problem on the network server and the traffic congestion problem 
on the network are reduced to some degree. But this single centralized network 
server configuration and topology still faces other problems: 

3 . If the storage device that stores the shared files is not available due 
20 to a) power outage, b) hardware failure, or c) scheduled 

maintenance, then the network clients that depend on the network 
server to store and to retrieve critical information from the shared 
files on that storage device will not function properly. To reduce 
the risk from such disasters, a disk array technology known as 
25 RAID (Redundant Array of Independent Disks) was developed to 

minimize the damage and more easily recover from failure due to 
the above mentioned situations. The RAID disk array technology 
can protect the files on the disk from damage or corruption by using 
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the techniques of striping, mirroring and parity checking, etc. But 
this only protects the storage system, and not the network server. 
4. If the network server goes down for any reason, it cannot store or 
retrieve critical information for the network clients. To deal with 
the problem caused when a network server goes down, the 
following two computer systems were designed: 

a. Fault-tolerant computer systems that require duplicate copies 
of every hardware component in the system as stand-by 
parts. 

b. Clustering systems which have more than one network 
server physically connected to the same storage system on 
which the shared files are located. All these network servers 
(or nodes) are running at the same time, but only one of 
them actually serves the clients' requests; the others function 
as stand-bys. When the primary server is down, a stand-by 
server kicks in and takes over the operation. 

With more CPUs on the system, RAID disk arrays, fault-tolerant computer 
systems and clustering network systems, many of the problems that are associated 
with sharing files by means of a server on the network seem to be overcome or 
reduced. However, in contrast to these expensive and cumbersome hardware 
solutions, a simpler and better way to achieve the same results is through a 
software solution. 

The root cause of the problems mentioned previously is the fact that there 
is only a single copy of shared files stored on the disk of the network server. The 
advantage of keeping one single copy of the shared files on the network is that it is 
easy to maintain and update the files. However, since there is only one copy of 
the shared files on the network, the following disadvantages result: 

1 . All clients systems on the network have to send their 

requests through multiple routers and/or switches before 



they reach the network server. Consequently, the network 
server is overloaded and the network becomes congested. 

2. No network can afford to let this single copy of shared 
information become unavailable, so a disk array with a 

5 RAID level is needed to protect the sole copy of files on the 

disk from becoming unavailable. 

3 . In addition to using the disk array to protect the shared 
information on the disk, a fault-tolerant system or clustering 
system is also needed as protection against network server 

10 failures, which can result from failures in any of several key 

components as well as from failure of the network server 
itself. 



Summary of the Invention 

These disadvantages can be mitigated or eliminated by using multiple 
15 network servers on the network, preferably one per sub-network. Each network 
server contains a copy of the shared files on its disk and shares them across the 
network. This arrangement works successfully as long as every copy of the files is 
identical and all copies are updated in real time whenever an update occurs on any 
copy. 

20 In accordance with the present invention, this objective is achieved by 

means of a mirror file system (MFS). A MFS is a virtual file system that links 
two or more file systems together and mirrors between them in real time. When 
the MFS receives updated data from an application, all file systems linked by the 
MFS are updated in real time. The file systems linked and mirrored through the 

25 mirror file system can be a local file system connected to a physical device, or a 
network file system exported by a remote system on a network. The real-time 
mirroring mechanism provided by the MFS is transparent to user applications. 
The system administrator first sets up the mirroring mechanism by linking a file 
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system to another file system on a single directory through an MFS mounting 
protocol. These two file systems and their files are linked together and become a 
mirroring pair. Both copies are owned by, and under the management of, the 
MFS. All access to files or directories in both file systems go through the MFS. 
5 The user applications perform normal file system operation and file/directory 
operation system calls like open, read, write and close functions from the 
pathname of either file system. Most of the file operations (such as a read 
operation) only need to go to one file system under the MFS to get the data. Only 
when updates occur, such as a write operation, the MFS mechanism ensures that 

10 all data updates go to both the file systems. With this mirroring mechanism of the 
MFS, the files/directories in one file system are mirrored to their mirroring 
counterparts of another file system in real time. With the MFS technology, a 
standalone system is able to make multiple copies of data available to the 
application. In the network environment, multiple servers owning the same data 

1 5 copy can be distributed on the network and mirror the data to each other in real 
time to provide more efficient and more reliable service to their clients. 

Hence, the mirror file system links any two regular file systems together 
and provides data management to make sure that the two file systems contain 
identical data and are synchronized with each other in real time. There are several 

20 benefits associated with the use of the mirror file system. A network server with 
the mirror file system on a sub-network can mirror its file system to another file 
system located on another network server, or on a different sub-network, in real 
time. Thus, the mirror file system allows critical information to be reflected 
simultaneously on multiple servers at different sub-networks, which synchronize 

25 with one another instantaneously so that neither time nor information is lost during 
updates. With real-time mirroring of critical information over the larger network, 
a client system can access the information on any network server. Although it is 
preferable to use the closest network server on its sub-network, a client system can 
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switch seamlessly to an alternate network server on another sub-network whenever 
necessary and continue to access the critical information without interruption. 

The mirror file system achieves the following major objectives of network 
operation: 

5 1 . It provides a complete solution to the RAS (Reliability, Availability, 

Serviceability) problem on all levels (storage, system, and network). 
Whenever a disk storage system, a system connected to it, or any 
network (or sub-network) component becomes unavailable due to 
power outage, system crash, hardware failure, or scheduled 

10 maintenance, the critical information remains available on another 

network server. All clients that cannot be served by their primary 
network server can switch to their secondary network server for 
virtually continuous access to the same critical information. The 
secondary network server can be deployed on a different sub- 

15 network of a large enterprise network, and can be located as far 

away as desired. 

2. It provides fast service for mission-critical applications. With more 
than one network server deployed on different sub-networks, a 
client can access the closest network server to get critical 

20 information faster; without the need to traverse many switches or 

routers on the enterprise network, which is the case when there is 
only one network server. 

3. It reduces network traffic congestion by serving identical 
information on multiple network servers. When a client can get the 

25 critical information from the closest network server on its sub- 

network, there is no need to travel outside the sub-network. This 
reduces total traffic on the large enterprise network as well as the 
cost of purchasing and maintaining multiple fast switches and 
routers. 
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4. It eliminates the problem of overloading a single network server. 
When a single network server is overloaded by an increasing 
number of requests from the clients, IT professionals can simply 
add more network servers on the enterprise's network instead of 

5 getting more CPUs for the single network server. Several small to 

mid-size network servers work better than a single centralized 
network server in terms of dealing with the RAS problem, 
providing fast service, and reducing network traffic. 

5. It distributes and balances workload and traffic among multiple 
10 network servers. With multiple network servers containing the 

same critical information, IT professionals can distribute and 
balance the workload and traffic on the enterprise's sub-network to 
make overall network operation considerably faster and smoother. 



Brief Description of the Drawing s 

15 Figure 1 is a block diagram of a conventional file system framework; 

Figure 2 is a block diagram of a file system incorporating the present 
invention; 

Figure 3 is a schematic illustration of mirroring between two file 
structures; 

20 Figure 4 is a schematic illustration of the manner in which the present 

invention links and mirrors between two file structures; 

Figure 5 is an illustration of a first embodiment of the invention, in which a 
standalone system mirrors between two local file systems; 

Figure 6 is an illustration of a second embodiment of the invention, 
25 comprising a master mirror server and a slave mirror server; 

Figure 7 is an illustration of a third embodiment of the invention, 
comprising two master mirror servers; 
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Figure 8 is an illustration of a fourth embodiment of the invention, in 
which a client mirrors two imported network file systems; 

Figure 9 is an illustration of a fifth embodiment of the invention, 
comprising two master mirror servers on a network; 
5 Figure 10 is an illustration of a sixth embodiment of the invention, in which 

a client links two imported mirror file systems on a network. 

Detailed Description 

A. Overview 

To facilitate an understanding of the invention, an overview will first be 
10 provided of a typical example of a file system. Most operating systems, such as 
Unix, provide multiple and different file system types within their operating 
environments. Some file systems, e.g. the Unix File System (UFS) or High Sierra 
File (HSFS) for CD-ROMs, have the physical storage to hold the actual file data; 
other file systems, e.g. Special Device File System (Specfs) or Network File 
15 System (NFS), do not have the physical storage. All these file systems observe 
interface conventions defined by the operating system, so that they can be loaded 
and plugged into the operating system easily. An application program can access 
the file data or device in these file systems by using the standard system calls 
provided by the operating system without the need to know the idiosyncrasies of 
20 each file system. 

The interfaces can be used: 

1 . Between the system calls and the underlying file systems: An 

application program makes system calls to access the file system or 
individual file/directory. The system calls convert those access 
25 requests into one or more file system or file/directory operation 

requests for the intended file system through the interface. The file 
system then presents those requests to its physical storage and 
returns the result back to the application program. 
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2. 



Between the file systems: A file system gets the file system and 
file/directory operation requests from the system call through the 
interface. It can present those requests to its physical storage, or 
send the request to another file system through the interface again 
and let another file system handle the activities of physical storage 
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The interfaces defined by the operating system fall into two categories; one 
is the interface for the file system itself; the other is the interfaces for individual 
files or directories within the file system. For ease of understanding, the 
terminology for interfaces as defined by the UNIX Operating System will be 
10 employed hereinafter. The interface for the file system is called the Virtual File 
System interface (VFS), and the interface for the individual file or directory is 
called the Virtual Node (VNODE) interface. 

1 . The Virtual File System (VFS) Interface 
The VFS interface has seven or eight interfaces/operations for a File 
15 System: 



All VFS interfaces are intended for the operations on a file system, such as 
25 mounting, unmounting, or synchronizing a file system. The VFS interface 

consists of two parts. One is the vfs structure, the other is the MACRO definitions 
for the vfs operation of the file system. 

The vfs structure is as follows: 



20 



1) 
2) 
3) 
4) 
5) 
6) 
7) 



vfsjnountQ 

vfsjmmountQ 

vfsj-ootQ 

vfs_statvfsQ 

vfs_syncQ 

yfs_vget() 
vfsjnountrootQ 



mounts a file system 

unmount a file system 

find the root for a file system 

gets the statistics of a file system 

sync the file system 

find the vnode that matches a file ID 

mount the file system on the root 

directory 



30 



/* 

* Structure per mounted file system. Each mounted file system has 

* an array of operations and an instance record. 
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* The file systems are kept on a singly linked list headed by "rootvfs" 

* and terminated by NULL. File system implementations should not 

* access this list; it's intended for use only in the kernel's vfs layer. 
*/ 



typedef struct vfs { 
struct vfs 
struct yfsops 
struct vnode 
10 uintj 
uintj 
int 

fsidj 
caddrj 

1 5 devj 
ulongj 
ushortj 
struct vfs 
struct vfs 

20 ksemaj 

}; 



*vfs_next; 
*vfs_op; 

*yfs_ynodecovered; 

vfsjlag; 

yfsbsize; 

vfs Jstype; 

vfs Jsid; 

vfsjdata; 

vfsjlev; 

vfs_bcount; 

vfs jisubmounts; 

vfsjist; 

*vfs_hash; 

vfsjreflock; 



/* next VFS in VFS list */ 
/* operations on VFS */ 
I* vnode mounted on */ 
/* flags */ 

/* native block size */ 

/*file system type index */ 

/*file system id */ 

/* private data */ 

/* device of mounted VFS */ 

/* I/O count (accounting) */ 

/* immediate sub-mount count*/ 

/* sync list pointer */ 

/* hash list pointer */ 

/* mount /unmount /sync lock */ 



Within the vfs structure, there is a vfsops struct containing file system 
operations like mount, unmount, sync, etc. that can be performed on the file 
25 system. 

The vfsops structure looks like the following: 

/* 

* Operations supported on virtual file system. 
*/ 

30 typedef struct vfsops { 



int 


(*vfs mount) (struct vfs * struct vnode *, struct mounta * 




struct cred *); 


int 


(*vfs jinmount) (struct vfs *, int, struct cred *); 


int 


(*vfs_root) (struct vfs *, struct vnode 


int 


(*vfs_statvfs) (struct vfs * struct statvfs64 *); 


int 


(*vfs_sync) (struct vfs * short, struct cred *J; 


int 


(*vfs vget) (struct vfs *, struct vnode **, struct fid *); 


int 


(*vfsjnountroot) (struct vfs *, enumwhymountroot); 


int 


(*vfs_swapvp) (struct vfs *, struct vnode ** char *); 


void 


(*vfsjreevfs) (struct vfs *); 


} vfsops J; 
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All of the functions in the vfsops structure are invoked through VFS 

MACROs, which are defined as follows; 

#define VFSJMOUNT(vfsp, mvp, uap, cr) \ 

(*(vfsp)->vfs_op->vfs_mount)(vfsp, mvp, uap, cr) 
5 #defme VFS_UNMOUNT(vfsp, flag, cr) \ 

(*(vfsp)->vfs_op->vfs_unmount)(vfsp, flag, cr) 
#defme VFS_ROOT(vfsp, vpp) \ 

(*(vfsp)- > vfs_op- > vfs_root)(vfsp, vpp) 
#define VFS_STATVFS(vfsp, sp) \ 
l o (*(vfsp)- > vfs_op- > vfs_statvfs)(vfsp, sp) 

#defme VFS_SYNC(vfsp, flag, cr) \ 

(*(vfsp)->vfs_op-> vfs_sync)(vfsp, flag, cr) 
#defme VFS_VGET(vfsp, vpp, fidp) \ 

(*(vfsp)-> vfs_op->vfs_vget)(vfsp ? vpp, fidp) 
15 #define VFS_MOUNTROOT(vfsp, init) \ 

(*(vfsp)- > vfs_op- > vfs_mountroot)(vfsp, init) 
#define VFS_SWAPVP(vfsp, vpp, nm) \ 

(*(vfsp)->vfsj3p->vfs_swapvp)(vfsp, vpp, nm) 
#define VFS_FREEVFS(vfsp) \ 
20 (*(vfsp)- > vfs_op- > vfs_freevfs)(vfsp) 

In the Unix operating system, every file system is allocated a vfs structure. 
When the operating system kernel receives a system call from an application 
program that intends to perform a file system operation on a file system, it uses the 
25 above MACROS with the vfs structure pointed to by the yfsp input parameter to 
invoke the file system operation on the file system. The MACROS are defined in 
a file-system-independent manner. With the input yfsp parameter, the kernel 
invokes the desired file system operation of a file system. 



2. The Virtual Node Interface 
30 The Vnode interface has about 30 to 40 interfaces/operations for a 

file/directory: 

1 . vop accessQ — Checks access to a file 

2. vop_close() — closes a file 

3. vop_create() — creates a file 
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5. 


vopJinkQ 


creates a link for a file 


6. 


vopJookupQ - 


looks up a path name for a file 


7. 


vopjnkdirQ - 


makes a directory 


8. 


vopypenQ 


opens a file 


9. 


vopreadQ 


reads the data from a file 



32. vop_setattr() « sets the attribute for a file 
35. vopjwriteQ — writes the data to a file 
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15 



All Vnode interfaces are intended for operation on an individual file or 
directory within a file system. Like the file system operations in the VFS 
interface, the Vnode Interface also consists of two parts, one part is the vnode 
structure, the other is the MACRO definitions for the vnode operations of the 
file/directory. 

The following is the vnode structure : 



20 



25 



30 



typedef struct vnode { 

kmutexj v__lock; 
ushortj v _flag>' 

uintj vjoount; 

struct vfs *v_vfsmountedhere; 

struct vnodeops *v_cp; 

struct vfs *v_yfsp; 

struct stdata *v stream; 

struct page *v _pages; 

enum vtype vjype; 

devj vjrdev; 

caddrj vjdata; 

struct filock *vJilocks; 

struct shrlocklist *v_shrlocks; 

kcondvarj vjcv; 

void *vJocality; 
} vnode J; 



/* protects vnode fields */ 
/* vnode flags (see below) */ 
/* reference count */ 
/* ptr to vfs mounted here */ 
/* vnode operations */ 
/* ptr to containing VFS */ 
/* associated stream */ 
/* vnode pages list */ 

/* vnode type */ 
/* device (VCHR, VBLK) */ 
/* private data forfs */ 
/* ptr to filock list */ 
/* ptr to shrlock list */ 
/* synchronize locking */ 
/* hook for locality info */ 
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Within the vnode structure, there is a vnodeops struct containing the 
file/directory operations such as vop_access(), vopypenQ, vopcreatf) and 
vopjwriteQ, etc. that can be performed on the associated vnode of a file/directory. 

The vnodeops structure looks like the following: 

5 typedef struct vnodeops { 

int (*vop_open) (struct vnode **vpp, int flag, struct cred *cr); 
int (*vop close) (struct vnode *vp, int flag, int count, 

offset J: offset, struct cred *cr); 
int (*vop read) (struct vnode *vp, struct uio *uiop, int ioflag, 
10 struct cred *cr); 

int (*vop_write) (struct vnode *vp, struct uio *uiop, int ioflag, 

struct cred *cr); 

int (*vopJoctl) (struct vnode *vp, int cmd, intptrj org, int flag, 

struct cred *cr, int *rvalp); 
15 int (*vop_setfl) (struct vnode *v/?, int oflags, int nflags, 

struct cred *cr); 

int (*vop_getattr) (struct vnode *vp, struct vattr *vap, int flags, 

struct cred *cr); 

int (*vopjsetattr) (struct vnode *vp, struct vattr *vap, int flags, 

20 int (*vop_access) (struct vnode *vp, int mode, int flags, 

struct cred *cr); 
int (*vop lookup) (struct vnode *dvp, char *nm, struct vnode 

**vpp, struct pathname *pnp, int flags, struct vnode 
*rdir, struct cred *); 

25 int (*vop_create) (struct vnode *dvp, char *nante, struct vattr 

*vap, vcexclj excl, int mode, struct vnode **vpp, 
struct cred *cr, int flag); 



30 int (*vopjnkdir) (struct vnode *dvp, char *dirname, 

struct vattr *vap, struct vnode **vpp, struct 
cred *cr); 

} vnodeops J; 

The functions in the vnodeops structure are invoked through the vnode 
35 operations MACROs. The MACROS definitions of vnode operations are 

the following: 
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#defme VOP_ACCESS(vp, mode, f, cr) \ 

(*(vp)->v_op->vop_access)(vp, mode, f, cr) 
#define VOP_CLOSE(vp, f, c, o, cr) 

(*(vp)->vjDp->vop_close)(vp, f, c, o, cr) 
#defme VOP_CREATE(dvp, p, vap, ex, mode, vpp, cr, flag) \ 

(*(dvp)->v_op->vop_create)(dvp, p, vap, ex, \ 

mode, vpp, cr, flag) 
#defme VOP_GETATTR(vp, vap, f, cr) \ 

(*(vp)->v_op->vop_getattr)(vp, vap, f, cr) 
#define VOP_LINK(tdvp, fvp, p, cr) \ 

(*(tdvp)->v_op->vopJink)(tdvp, fvp, p, cr) 
#define VOP_LOOKUP (vp, cp, vpp, pnp, f, rdir, cr) \ 
(*(vp)->v_op->vop_lookup)(vp, cp, vpp, pnp, 

f, rdir, cr) 

#define VOP_MKDIR(dp, p, vap, vpp, cr) \ 

(*(dp)->v_op->vop_mkdir)(dp, p, vap, vpp, cr) 
#define VOP_OPEN(vpp, mode, cr) \ 

(*(*(vpp))->v_op->vop_open)(vpp, mode, cr) 
#defme VOP_READ(vp, uiop, iof, cr) \ 

(*(vp)->v_op->vop_read)(vp, uiop, iof, cr) 



#define VOP_WRITE(vp, uiop, iof, cr) \ 

(*(vp)->v_op->vop_write)(vp, uiop, iof, cr) 

#define VOP_SETATTR(vp, vap, f, cr) \ 

(*(vp)->v_op->vop_setattr)(vp, vap, f, cr) 

Every file or directory in the file system is allocated a vnode structure that 
holds all information about that file or directory. 
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When the operating system kernel receives a file or directory operation 
system call from an application program that intends to perform an operation on a 
file or directory, it uses the foregoing macros with the information in the vnode 
structure pointed to by the vp input parameter to invoke the desired vnode 
operation on the file or directory. 

Figure 1 shows the layout of several file systems and the VFS, Vnode 
interfaces in the operating system. 

The operation and data flow proceed as follows: 

a. A user application 10 makes a file system operation or file operation 
system call into the operating system 12. 

b. The system call generates one or more VFS and Vnode operation 
calls 14. 

c. The VFS and Vnode operation calls then go through the VFS and 
Vnode interface layer 16 to switch to the intended file system 18. 

d. The intended file system sends the VFS and Vnode operation to its 
physical storage 20 and gets the result. 

e. The intended file system returns the result back to the application 
program 10. 

3 . The mirror file system interface 

The mirror file system of the present invention, like other file systems, 
also follows the VFS and Vnode interfaces, so it can be loaded and plugged into 
the operating system. The application 10 uses the same system calls to access the 
file system and individual file/directory within the mirror file system. The mirror 
file system does not have physical storage; instead it has two or more file systems 
under it. Each of the file systems under the mirror file system has a local physical 
storage 18a, e.g. UFS, or a remote physical storage 18b on another system, e.g. 
NFS. The UFS or NFS under the mirror file system has the same VFS and Vnode 
interfaces as it normally would. The mirror file system use these standard 
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interfaces to perform the operations on the UFS/NFS file systems and their 
individual files or directories. 

Figure 2 shows several file systems and the mirror file system in an 
operating system. The mirror file system 22 is loaded on top of a Unix File 
System (UFS) and a Network File System(NFS). Other UFS and NFS file systems 
can co-exist in parallel with MFS as shown in the figure. When the MFS is 
loaded into the system, it links the two file systems, UFS and NFS, together 
through its mount protocol. After the mount operation, the UFS and NFS are 
under the management of MFS. All system calls for file system operations and 
individual file/directory operations from the application are directed to the MFS 
first via the same VFS and Vnode interfaces. When it receives the VFS or Vnode 
operation from the system calls originated by the application, the MFS first 
performs some housekeeping tasks on the operations, and then sends the operations 
to UFS and NFS via the VFS and Vnode interface again. By keeping the same 
VFS and Vnode interface between the system call and MFS, and between the MFS 
and the underlying UFS and NFS, the MFS achieves the following goals: 

1) The application does not need to re-compile or to re-link. The path 
name for a file or directory accessed by the application remains 
intact. No new directory or symbolic links are created or needed 
for the application to function properly with the MFS mounted. 
Consequently, the application need not be aware of the existence of 
the MFS in the system. The application can access the mirror file 
system and its file/directory in the same manner as it did before the 
MFS was loaded into the system. 

2) The UFS and NFS do not need any changes. They can a) co-exist 
in parallel with the MFS as a standalone file system like UFS(l) and 
NFS(l), or b) be linked and managed by the MFS as a sub-file 
system like UFS(2) and NFS(2) in Figure 2. In the first case, the 
UFS or NFS receives the VFS and Vnode operations from the 
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system call originated by the application and sends the operations to 
its physical storage; in the second case the UFS and NFS receive 
VFS and Vnode operations from the MFS, and then send the 
operations to their physical storage. 
5 3) It is a building block approach. The MFS is built on top of existing 

UFS and NFS. Another file system can also be built on top of the 
MFS and other file system jointly or independently, and be plugged 
into the operating system. 



B. Exemplary Embodiment 
]0 A more detailed description of the mirror file system of the present 

invention is presented hereinafter. 

1 . The MFS Mount Protocol 

In the Unix operating system, every file system mounted by the system has 
a virtual file system data structure named vfs that contains information about the 

15 file system and its operations as described before. Normally only one file system 
can be mounted on a directory. When a new file system is mounted on a 
directory, the directory's previous contents are hidden and cannot be accessed until 
the new file system is unmounted from the directory. Hence, the application can 
only see the contents of the new file system when accessing the directory. In 

20 contrast, when the MFS links file systems together and forms a mirroring pair, the 
MFS mount protocol mounts two file systems on a single directory. This protocol 
provides a new approach for mounting a file system on a directory. 

a. The MFS mount protocol allows either an entire file system 
of part of a file system (represented by a directory) to be 

25 mounted on a directory. 

b. When the MFS mounts a directory with a file system or a 
part of a file system, the previous contents of the mounted 
directory are not hidden. 
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c. The MFS inherits all of the contents of the mounted 
directory into its mfs_yfs virtual file system data structure. 
The inherited content is a copy of a mirroring pair. The new 
file system mounted on the directory is the other copy of the 

5 mirroring pair, all its contents are also inherited by MFS and 

put into the MFS file system data sture mfs_vfs. 

d. The application still sees the previous contents of the 
mounted directory through its previous path name. The 
application also sees the contents of the newly mounted file 

10 system through its previous path name. 



The mfs_yfs file system is a virtual file system that holds the information 
for itself and two other file systems, one of which is inherited from the mounted 
directory, and the other of which is the new file system that was mounted. Hence, 
the mfs_yfs structure contains three vfs data structures, one is the MFS itself, the 
15 other two vfs structures are for the two file systems linked by the MFS. The super 
mfs yfs data structure looks like the following: 



20 



Struct mfs_vfs { 
Struct vfs 
Struct vfs 
Int 

Struct vfs 
Int 



25 



}; 



Other fields 



*mfs; 
*X_vfs; 
X_vfs_state; 
*Y_vfs; 
Y vfs state; 



/ * mirror file system vfs */ 
/* first file systems vfs */ 
/* state of X_vfs file system */ 
/* second file system vfs */ 
/* state of Yvfs file system */ 



After a file system represented by a directory is mounted on another 
directory by the MFS mount protocol, these two file systems are linked together 
and become a mirroring pair under the management of MFS operation. Figure 2 
30 shows that the UFS(2) and NFS(2) are linked together by the MFS mount protocol 
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and become a mirroring pair. The MFS can mirror the entire file systems or a 
portion of the file systems between a mirroring pair. 

Figs. 3 and 4 illustrate how the File System A 201 and the File System B 
202 link and mirror each other. In Fig. 3, the structure B 220 under directory b 
5 21 1 of the File System A 201 is to be linked to structure Y 221 of the File System 
B 202 and mirror each other. The file system mount operation of MFS is the key 
for linking up these two file structures 220 and 221, so the two file structures 
become a mirroring pair. The file system mount operation is described in detail 
below. 

10 To link up these two file structures and make them a mirroring pair, the 

MFS can do the one of the following two things: 

a. Mount the directory y 221 of the File System B 202 onto the 
directory b 211 of the File System A 201. 

b. Mount the directory b 211 of the File System A 201 onto the 
15 directory y 221 of the File System B 202. 

It is not significant which directory of which file system is to be the mount 
point for other file system. Since the file systems are a mirroring pair, they all 
have same privileges by default. 

The MFS mount operation sets up the data structure mfs_yfs to contain the 
20 vfs data structures for these two file system structures. After the mount operation, 
the following structures and relationships are created as depicted in Fig. 4: 

1) A new virtual file system mirror file system 203 is created. The 
new mirror file system 203 is a layered virtual file system on top of 
File System A 201 and File System B 202. It has a data structure 

25 containing the file system and file operation information of File 

System 201 and File System 202. 

2) The newly created mirror file system 203 has all the elements of 
both the Structure B 220 (Fig. 3) of the File System A 201 and 
Structure Y 221 of the File System B 202. It has directories b/y 
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231, c 232, d 233, z 238 and f 235, files e 234, g 236, h 237 and y 
239. Each element is either a file or a directory. 

3) The directory b/y 231 of the mirror file system 203 becomes the 
root directory of mirror file system 203 . 

4) All elements of structure B 220 (Fig. 3) of File System A 201 are 
mirrored to directory y of File System B 202. All elements of 
structure Y 221 of File System B 202 are also mirrored to directory 
b of File System A 201. In other words, all of the elements of 
structure B and structure Y are copied to a physical storage device 
of File System A and B, so the structures in the two file systems are 
synchronized with each other after the MFS mount operation. 

5) If there is a file or directory that exists on both file systems, then 
the timestamp of the file or directory is used to decide which copy is 
to be preserved. 

6) An application can access the root directory b/y of MFS by using 
the path name from either file system, /A/b or /X/y, and get to the 
root node of the newly created MFS. All file system operations, as 
well as individual file or directory operations, are handled by the 
MFS for all the files and directories under the root directory b/y of 
the newly created MFS. 

2. The MFS Unmount Protocol 

To break the mirroring setup, the mirror file system unmounts directory y 
of File System B 202 from the directory b of the File System A 201 . Then all 
relationships are reverted back to their original state. The two file systems that 
were linked and mirrored to each other by the MFS are independent of one another 
again. 

Fig. 1 shows the original file systems layout after MFS umounting ufs(2) 
and nfs(2) from Fig. 2. 



-20- 



3. File/Directory Operations 

After two file systems are linked and mounted on a directory by the MFS 
mount protocol, the individual files and directories within the two file systems are 
ready to accept operations from the MFS and the application. 
5 Every element of a file system, file or directory, has a vnode data structure 

containing information and the operations can be performed on this file or 
directory. 

In Unix and other operating systems, normally only one vnode data 
structure is allocated per file or directory. Since the MFS has two file systems 

10 under its management, each file or directory in the MFS has two files or 

directories under its management, one for each of the two file systems. Every file 
or directory of MFS will have a super vnode structure called mnode. This mnode 
contains a vnode structure and two vnode pointers. The vnode named m vnode is 
the vnode for the file or directory within MFS, the two vnode pointers, *m_Xvp 

15 and *m_Yvp, point to the real vnode of the file or directory within the two file 

systems. The mnode data structure of MFS File System looks like the following: 



20 
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/* 

* The mnode is the "vnode "for mirror files. It contains 

* all the information necessary to handle two real vnodes it links 
*/ 

typedef struct mnode { 



struct vnode 
struct mnode 
struct vnode 
struct vnode 
int 



mjynode; 
*m_next; 
*m_Xvp; 
m_Yvp; 
state; 



/* vnode for mirror file system */ 
/* link for hash chain */ 
/* pointer to X vnode */ 
/* pointer to Y vnode */ 
/* state of the mnode */ 



} mnode J; 



Fig. 4 shows a detailed picture of what the MFS looks like and its 
30 relationship with two underlying file systems. The directory b/y 231 is a newly 
created directory, the root of new mirror file system 203. The directory b/y 231 
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of mirror file system 203 is a virtual directory, there is no physical storage for any 
file or directory within the mirror file system. But the directory b/y 231 of mirror 
file system 203 has a mnode data structure allocated by the MFS. Within its 
mnode, it has two pointers; one pointer named m_Xvp points to the b directory of 
5 File System A 201; the other pointer named mjtvp points to y directory of File 
System B 202. These two directories pointed to by two pointers of mnode reside 
in the physical storage devices. 

When an application program 10 accesses either 1) the b directory of File 
System A 201 by using the path name of I Alb from the File System A, or 2) the y 

10 directory of File System B 202 by using the path name /X/y from the File System 
B 202 as it did before the MFS is mounted, the system detects that the directory b 
or directory y has the mirror file system 203 mounted on it (by checking the 
v vfsmountedhere field of the vnode), and it becomes the root directory b/y 231 of 
mirror file system 203. All file access requests (open, read, write, seek, close, 

15 etc.) are directed to the vnode operation {struct vnodeops *v_op) of vnode for the 
virtual directory b 231 of mirror file system 203. When the vnode operation (for 
example, the vopopenQ operation for an open request from the application) of 
directory b 231 gets the open request, it will first get the mnode from private data 
field vjdata of its vnode. From the mnode, the vop_open() operation finds both 

20 the vnodes of directory b of File System A 201 and the vnode of directory y of File 
System B 202. The open request is then sent to vopj>pen{) operations of both 
vnodes. The codes for vop _open() in mirror file system look like the following: 
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static int 

mfs_open(register vnode J **vpp, 
int flag, 

struct cred *cr) 



{ 



30 



struct mnode 
vnode J 
vnode J 
vnode t 



*mp ; 
vp = vpp; 
*X_yp; 
*F_vp; 



/* mnode for MFS */ 
/* vnode for MFS */ 
/* vnode ofX copy */ 
/* vnode of Y copy */ 
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int X error = -1, Y error = -1; 



/* 

* process open for X vnode 

*/ 

mp = vp-> vdata ; /* get the mnode */ 

Xvp = mp->X_yp; /* get X vnode */ 

I* 

* send the request to vop_open() ofX vnode 
*/ 

X_error = VOP_OPEN(&X_vp, flag, cr); 



/* 

* process open for Y vnode 

*/ 

Y_yp = mp- > Y vp; /* get Y vnode */ 
/* 

* send the request to vop_open() of Y vnode 
*/ 

Y_error = VOP_OPEN(&Y_vp, flag, cr); 

} 

return (K error \ Y error); 

} 



All other vnode operations like mfs_read(), mfs_write(), mfs_setattr(), 
mfs_close(), etc., follow the same procedure as described in mfsjopenQ to perform 
the same identical operations with the same parameters on both copies of the 
mirroring pair. This is how the mirror file system achieves the real-time mirroring 
effect between the mirroring pair. 



4. One Read and Two Write Operations 

Since both X and Y copies contain identical information, not every 
operation needs to be performed on both X and Y copies. For example, the read 
operation can get all information from either the X or Y copy. 
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The mirror file system basically applies the following rules in deciding 
which operation goes to which copy: 

a. For Open and Create operations, the mirror file system will 
invoke the operations that go to both X and Y copies. 
5 b. For a Read operation, the mirror file system only needs to 

invoke the operation that goes to one copy to obtain the 
requested data. Which copy a file operation goes to is 
configurable during the MFS mount operation, 
c. For Write file operations, the mirror file system will invoke 
10 the operations that go to both X and Y copies. 

5. Configuration of Master and Slave 

The preceding section describes how the MFS mount protocol sets up a 
mirroring pair and how the file operations operate on the mirroring pair. The 
privileges of the pairs are equal, that is, either one can mirror its contents to its 
15 counterpart in real time. The user can also configure the pairs into a Master and 
Slave relationship. One file system is the Master; the other one is the Slave. The 
Master can mirror its contents to its Slave, but not the other way. The Master- 
Slave configuration may be desirable when one of the mirroring pair is a Network 
File System that has the physical storage on the remote host. 

20 6, Data Coherency and Consistency 

As discussed previously, the write operation will go to both copies. To 
make sure that the two copies will be identical at all times, the write operation on 
both copies should be atomic; in other words, during the data writing to both 
copies, no other operations (read and/or write) should be allowed on the two 

25 copies. To achieve this, a locking mechanism is needed. The MFSs' vopjwriteQ 
operation acquires the locks by calling the vop rwlockQ operation of the first 
vnode, then acquires the lock for second vnode. Both locks of vnode have to be 
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secured before the writing can proceed. If only one lock is granted, and the other 
one is held by another process, the MFS releases the first lock it is holding to 
avoid a deadlock in the case that another process that held the second lock also is 
trying to hold the first lock. After releasing the lock of the first vnode, the 
vop_write() operation uses a backoff algorithm to wait for a period of time before 
trying to acquire the locks on both vnodes again. 

7. MFS Failover and Recover Operations 

Most of the file operation requests from the application can be executed on 
the X copy 204 and get all correct data. The X copy 204 may become unavailable 
due to: 

a. Maintenance work on the physical device of the X copy, or 

b. Hardware failure on the controller or disk, or the network is 
down and the Network File System under MFS cannot be 
reached. 

When this occurs, the mirror file system 203 switches the file operations to the Y 
copy to get the correct information. 

The recover or re-sync operation of MFS after the failover is the following: 

1) In case a, the MFS is signaled by an application that issues IOCTL 
calls to tell the MFS that the X copy will be taken down. When the 
MFS receives the call, it flags the state of X copy in the mfs_vfs 
structure to be an unavailable state. 

2) In case b, the MFS flags the state of X copy after retrying the 
operation a pre-defined number of times without success. 

From that point on the state of X copy is changed and the MFS does not invoke 
any file operation of X copy, and keeps a log of what vnode (file or directory) has 
been updated on the Y copy. When the X copy comes back on line again, the 
application issues another call to signal MFS that the X copy is back on line again. 
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The MFS then changes the state of X copy in the mfs_vfs structure to the available 
state. The MFS then syncs the X copy with the vnodes that were updated in the 
meantime, as stored in the log, and changes the state of the X copy in the mfsjrfs 
structure to be the available state. 
5 If the down time of the X copy becomes too long, so that the log entry of 

vnodes overflows, then the MFS re-syncs the entire X copy with the contents of Y 
copy, similar to the re-sync operation of MFS mount protocol, when it receives the 
signal from the application. 

8. Sharing the Mirror File System on the Network 
10 Once the two file system are linked by the MFS and set up on a network 

server, the mirror file system can be exported and shared by all clients on the 
network using the NFS share command and protocol. The clients can mount the 
mirror file system from the network server across the network and access it as if it 
were a local file system. All the mirroring is carried out on the network server. 
15 The command that shares or exports the mirror file system is the same command 
that is used to share any other file system; there is no additional file or database 
required to do the sharing or exporting. For the client to import or to mount the 
shared mirror file system on its system, it uses the same command as that which is 
used for importing or mounting other shared file systems. 

20 C. Configuration and Application 

The preceding sections describe how the mirror file system links and 
mirrors between file systems within a computer system. This section discusses 
how the mirror file system can be configured in the following system 
environments: 

25 a. Standalone system 

b. A server system in a network environment 

c. A client system using the mirror file system 
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1. Mirror Between Two Local File Systems 

Fig, 5 illustrates how a standalone mirror system X uses mirror file system 
X linking and mirroring between a local file system A and a local file system B. 
The local file system A has its data stored on a physical device Disk A; the local 
file system B has its data stored on Disk B. The two local file systems are linked 
and become a mirroring pair by the MFS mount protocol. 

When Application 1 sends a file operation request 11 to mirror file system 
X, the mirror file system X will: 

a. Invoke the file operation 13 on local file system A. The local file 
system A then sends the request 15 to the physical device Data A; 

b. Then the mirror file system X invokes the file operation 14 on the 
local file system B. The local file system B then sends the request 
16 to the physical device Data B. 

In the case of a read file operation, MFS only needs to invoke the operation 
in local file system A. The manner in which MFS links and mirrors between these 
two file systems is described in the preceding sections. 

2. Mirror Between One Local File System and One Network File 

System 

Fig. 6 illustrates how a network server Master Mirror Server X uses mirror 
file system X to link and mirror between a local file system A and an Imported 
Network File system B. The local file system A has a physical device Data X on 
the Master Mirror Server X system, the Imported Network File system B is a 
Network File System (NFS) exported from a Slave Mirror Server Y on the 
network. Its physical storage is the Data B on the Slave Mirror Server Y. The 
mounting protocol, file system and file operations are the same as the two local file 
systems mirroring configuration described previously. 
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In this configuration, the Master Mirror Server X acts as a Master mirror 
system and the Slave Mirror Server Y acts as a Slave mirror system. The 
following two scenarios illustrate the Master-Slave relationship: 

a. When the Master Mirror Server X updates one of the MFS pair- 
the local file system A or Imported Network File System B, the 
physical storage Data A will get updated and the Physical storage 
Data B of Imported Network File System B on the Slave Mirror 
Server Y will also get updated via the NFS protocol. 

b. When the Slave Mirror Server Y updates its physical storage B 
through its local file system B, the updates will not go to physical 
storage Data A of Master Mirror Server X because the Slave Mirror 
Server Y does not have the MFS to carry out the mirroring. In that 
regard, the system is only a mirror slave system. It can receive the 
update from the Master Mirror Server X, but it cannot mirror its 
contents to the Master Mirror system. 

For a mirror server to be a master mirror server on the network, it needs 
an imported network file system that is exported or shared by and has a physical 
storage on a network server. In the above example, the Master Mirror Server X 
can be a master mirror server due to the fact that it has an Imported Network File 
System B that it can link together with its local file system A through MFS. 

Fig. 7 shows how the Slave Mirror Server Y in Fig. 6 can be turned into a 
Master Mirror Server Y. To do that, as shown in Fig. 7, the Mirror Server X 
needs to export 60 its local file system A as the exported local file system A to the 
Master Mirror Server Y via network file system protocol 61 over the network, e.g. 
via Ethernet. The Master Mirror Server Y then links the Imported Network File 
System A and its local file system B together with the mirror file system Y. 

When that is done, two master mirror servers reside on the network. These 
two master mirror servers mirror and backup each other on the network. An 
application can run on either master mirror server and get all needed information. 
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3. Mirror Between Two Imported Network File Systems 
Fig. 8 illustrates how the Client Mirror System Z uses mirror file system Z 
linking and mirroring between imported Network File system A and imported 
Network File System B. In this configuration, the two imported network file 
systems are the network file systems imported from remote systems on the 
network. The physical devices of the imported network file systems are on the 
remote computer systems on the network. 

These two imported network file system are mounted on a single directory 
by MFS, preferably the same directory that the applications have accessed. Since 
there are two file systems to be mounted, the mount protocol provides a new 
argument to indicate that the previous contents of the mounted directory should be 
hidden after the MFS mount operation. The contents of the two imported file 
systems are inherited into mfs_vfs structure, as described previously. 

In this configuration, the Client Mirror System Z is a client to access file 
systems on two servers, one is designated the primary server, and the other is 
designated a secondary server. The primary server may be deployed on the clients' 
sub-network; the secondary server can be deployed on a different subnet and be far 
away physically. When the primary server becomes unavailable, the client can 
switch to the secondary server. For most file system or file operations, especially 
the read-related operations, the client only needs to access the primary server. The 
client only needs to access the secondary server when doing the write-related 
operations. 

4. Sharing Mirror File System on the Network 
Fig. 9 depicts how two Master Mirror Servers on the network can serve 
their users better by mirroring and backing up each other. One can make this 
configuration even better by sharing the Mirroring File Systems across the network 
to let the clients access them as the local file system. Every client can choose the 
closest Master Mirror Server on the network as its primary Mirror Server and the 
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other one as its secondary Mirror Server. Ideally, the Master Mirror Server will 
be on the same subnet as all its clients to save much of the traffic from going 
through network routers and switches. If the primary Mirror Server becomes 
unavailable, the clients can switch to the secondary Mirror Server. 

With reference to Fig. 9, the following is a scenario describing how the 
data flows between the Client and Mirror Servers: 

1) Server exports the mirror file system. To share its mirror file 
system X 655 with client systems on the network, the Master Mirror 
Server X 650 needs to export 603 its mirror file system X 655 as 
the Exported mirror file system X 651 using the Network File 
System Protocol 606 to its Client System X 670 on the network, 
ideally on the same subnet. 

2) Client imports the mirror file system. The Client System X 670 on 
the network imports the Exported mirror file system X 651 from the 
Master Mirror Server X 650 as its Imported mirror file system X 
671 by using the Network File System protocol 606. 

3) Applications on the client access shared mirror file system. When 
an Application 6 on the Client System X 670 makes an update 632 
on the Imported mirror file system X 671, the update is sent 606 by 
using the Network File System Protocol to the Exported mirror file 
system X 651 on the Master Mirror Server X 650. 

4) The mirror file system X updates two file systems under its 
management. When the mirror file system X 655 of Master Mirror 
Server X 650 receives 603 the update through its Exported mirror 
file system X 651, it does the following: 

a. Send 604 the update to the local file system A 652 first. The 
local file system A 652 then sends 607 the update to its 
physical device Data A 656. 
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b. Send 605 the update to its Imported Network File System B 
654. The Imported Network File System 654 then sends 609 
the update via a Network File System protocol to the 
Exported Network File system 664 on the Master Mirror 

5 Server Y 660. 

c. The local file system B 663 of Master Mirror Server Y660 
receives 625 the update from its Exported Network File 
System B 664 and sends it 624 to the physical device Data B 
666. 

10 After the above steps are done, a copy of the update is stored in Data A 656 of 

Master Mirror Server X 650, and another copy is stored in Data B 666 of Master 
Mirror Server Y 660. 

5. A Client Links Two Imported Mirror File Systems 

Fig. 10 shows a client that links two imported Mirror Master Servers. The 

15 configuration is the combination of configurations illustrated in Figures 8 and 9. 
In this configuration, the MFS mount protocol allows a file system like the 
Imported mirror file system 702 to be designated as the Active File System and the 
other File System, the Imported mirror file system 703, to be designated as the 
Passive File System during the MFS mount. The client only accesses the Active 

20 File System until the Active File System becomes unavailable. When the Active 
File System is not responding to the client's request, the client will failover to the 
Passive File System and continue its operation. 

In this configuration, the client system X 670 imports and links two Mirror 
File systems, one from Master Mirror Server X and the other from Master Mirror 

25 Server Y. Since these two imported Mirror file systems mirror each other on their 
own Master Mirror Servers X and Y, the Client system X 670 does not need to do 
any mirroring between these two imported Mirror file systems, all the mirroring is 
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done on the Master Mirror Server X and Y. The configuration is different from 
the configuration of Figure 8 in the following respects: 

1. The client does not have to do the mirroring between the two 
imported mirror file systems. 

2. The client uses one imported mirror file system as its active file 
system, the other one as the passive file system. 

3. The client only needs to access the active file system to get all 
needed information at any given time, this includes read and write 
operations. When the client does a write operation on the active file 
system, the Master Mirror Server X will carry out the mirroring to 
the file system on the Master Mirror Server Y. 

4. If the active file system becomes unavailable, the client can failover 
to the passive file system and continue its operation seamlessly. 

5. When the active file system is back on line again, all recovery and 
re-sync are done on the master mirror server, not on the client. 

This configuration can provide clients a very smooth, reliable and efficient 
network operation. 
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